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EXPANSION OF FUNCTIONS IN TERMS OF CHEBYSHEV POLYNOMIALS 



SUMMARY 

If f{x) is continuous and of bounded variation in the range -1<x<+1, it 
can be expanded in terms of Chebyshev polynomials. The numerical procedure 
for such expansion is given in detail. The reverse process of evaluating an ex- 
pression for which the 'Chebyshev coefficients' are known is also fully con- 
sidered, for cases in which these coefficients can be more easily derived from 
the data than a simple, explicit formula for f(x). The process of expansion is 
closely related to that of Fourier analysis. Such expansion has marked advan- 
tages, notably that the error committed by terminating the series at any point 
can be easily estimated, not only for f{x) but for its integral and derivative. The 
goodness of fit between this terminated series and f(x) is discussed. Such ex- 
pansion can be used for the approximate solution of ordinary linear differential 
equations, particularly those having coefficients which are polynomials of low 
degree in x. 

This matter is fully discussed by Clenshaw. What follows is essentially 
a simplified version of Clenshaw' s paper, designed to help the engineer who 
wishes to work to an accuracy of at most three or four significant figures, and to 
take advantage of the ideas and techniques Clenshaw has so thoroughly estab- 
lished. 



1. INTRODUCTION 

Suppose we are given a function f{x) which is 
continuous and bounded in a finite range of x, say 
a<x<b. If we are able to express f{x) exactly in terms 
of polynomials, trigonometric, exponential and other 
elementary functions, this is a great advantage, be- 
cause any necessary manipulations, including inte- 
gration and differentiation, are easily performed upon 
elementary functions. But if fa example f{x) is the 
Bessel function Jo(x) of the first kind of zero order, 
it is not possible to express it exactly in terms of 
elementary functions. Approximate expressions for 
f(x), for a limited range of values of x, in terms of 
elementary functions can be obtained in various ways, 
but one way which has certain marked advantages is 
to express f(x) as an infinite series of Chebyshev 
polynomials, and obtain the required approximation 
by truncating the series, that is, terminating it after 
say the (n + 1)th term. Clenshaw' has studied this 
technique thoroughly, and gives 'Chebyshev coeffi- 
cients' for various well known mathematical functions 



to 20 significant figures in most of the cases he 
studied. He also discusses the relevant properties 
of Chebyshev polynomials, and means for evaluating 
approximations directly in terms of the 'Chebyshev 
coefficients.' Clenshaw's paper includes a bibliog- 
raphy of 28 references, so that it is firmly based on 
previous work but is also sufficient by itself to enable 
a mathematically inclined reader to learn the best 
techniques for expressing a function in terms of 
Chebyshev polynomials and deriving the maximum 
advantage with the minimum effort from so doing. 

The objective here is much more limited — to 
enable an engineer to obtain an approximation accurate 
to at most four or five significant figures for a given 
function f{x) (which may not be in explicit or closed 
form, but may instead be say the solution of a dif- 
ferential equation) and to permit easy numerical 
manipulation of such an approximation when it has 
been obtained. Clenshaw' shows clearly that the 
'obvious' ways of carrying out such manipulations 
are not necessarily the best. 
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Fundamental properties of Chebyshev polynomials 
are discussed in Section 2, together witli the derivation 
of 'Chebyshev coefficients' for a given f{x). Fig. 1, 
which is taken from Reference 2, illustrates the 
general behaviour of the firstsix of these polynomials. 
If an arbitrary function <^{x) is expressed approx- 
imately as a finite series of Chebyshev polynomials, 
its derivative or integral, and other related functions, 
can be w/ritten down in the same form immediately; 
the outstanding features of behaviour can then per- 
haps be inferred qualitatively from Fig. 1 and quanti- 
tatively from the procedures discussed below. This 
can be important where <fi{x) cannot be expressed 
simply in closed form (for example, because it is 
only known as the solution of a differential equation 
or because cf)(x) has a closed form which is compli- 
cated or unfamiliar). Economies in the numerical 
evaluation of f(x) in terms of its 'Chebyshev coeffic- 
ients* are the subject of Section 3. A particular case 
is discussed in Section 4. Errors due to truncation 
of a 'Chebyshev series,' and the goodness of fit 
between f{x) and the sum of the truncated series, are 
considered in Section 5. In Section 6 'Chebyshev 
coefficients' are determined for a function defined as 
the solution of an ordinary linear differential equation. 
Special attention is given to the particular case when 
the differential equation is known to have the ex- 
pression discussed in Section 4 as an exact, explicit 
solution. The marked advantages of 'Chebyshev- 
series' approximations are discussed in Section 7. 



2. FUNDAIVIENTAL PROPERTIES OF CHEBYSHEV 
POLYNOMIALS 

We shall follow Clenshaw^ in taking the definition 
of the Chebyshev polynomial T„(x) of order n to be 



T„(x) = cos {ncos' x) (-1<x<1) 



If we put 



X = COS0 

then (1) becomes 

T„(x) = cosnO 



(O<0<7r) 



(1) 



(2) 



(3) 



If we require to express cf>(y) in terms of Chebyshev 
polynomials over the range a<y<6 instead of-1<y<+1, 
it is convenient to write 



y2r(b-a)x + (6+a)j 



(4) 



and work in terms of x instead of y as much as pos- 
sible. Likewise, if we require a range >'>C>0 for y, 
we should put 



y =2C/(x + 1) 



(5) 



and, again, work in terms of x as much as possible. 
We shall therefore assume in what follows that we are 
required to expand a function f(x) of x approximately 




-04 



Fig. 1 -Chebyshev polynomials with the normalisation 
used in this report 



in terms of Chebyshev polynomials over the range 
-1<x<1. f(x) may be known explicitly, or we may be 
given information leading to the determination of 
f(x), such as that f(x) satisfies a differential equation 
and appropriate boundary conditions. 

If we use equations (2) and (3) and work in terms 
of d, we see that any relation of the form 

fix) = ficosd) = Vioo +aicos0 + oq cqs26 + . . . . 

is in effect expressing as a Fourier series the func- 
tion /(cosQ), which is even in Q and periodic with 
period 2rr. It therefore follows that 



2 
Or =- 



Acos0) cos r6 6d 



(6) 



and it is also well known that 

cos(r + 1)i9 + cos(r-1)i9 = 2cos9 cosrO 
cos e 
'Acos 20 



cos rO sin(9 df) = 



^ /cos[r+1]0 cos[r-l]6i\ 
' \ r + 1 ~Ta / 



77 

1 



77 (r = s = 0) 
cos rO cos sd dd= (77/2 (r = s ^ 0)\ 
O(r^s) 



(7) 
r = 0l 

r = 1 

(8) 
(9) 



By substituting from (2) and (3), we can express 
equations (6), (7), (8) and (9) directly in terms of x 
in the form 



I 



T,(x) dx 



1 

2 U(x) JM) dx 

-1 

T, + 1 (x) - 2x T,(x) + T,.i (x) = 

Ti(x) r = 0\ 

'/4T2{x) r = 1 



r+1 



r-1 



r> 1 



(10) 



(11) 



(12) 



1 

1 



' TT (r = s = 0) 



.^^-H. 



T,(x) T^,(x) (1-x )-''dx = [Vm (r = s / 0) 

(r ^ s) 



(13) 



Altliough (10), wfiicfi is equivalent to (6), appears 
to be the obvious way of deriving the coefficients, a^ 
when f(x) is known explicitly, it is not necessarily the 
best way. It can be shown that if «>0 and r and s 
are both<n 



v^\^+(-^y^^^Y^oos'^ 



cos 



snq 



and this, expressed in terms of x, is 



yJu (^1)^+^1 +VTr' 

q=l 



(Xg) Ts'^Xq) 



where 



If we define 



Xg = cos(g77/«) 



^ n 



%/-(i)+y2(-i)7(-i) + 



n (r = s = Oorn) 
Vm (r = s ?^ or n) 

O(r^s) 

(14) 

w (r = s =Oorn) j 

y2n(r = s ^Oorn)| 

O(r^s) I 

(15) 

(16) 
(17) 



g=i J 



then it can be shown by means of (15) that if f(x) is 
a polynomial of degree less than n 

aj = Qj (18) 

whereas in general 



But if n is sufficiently large, we can neglect {or-a^) 
in (19), and write 



n 
/'(x)«y2ao +/_]ar "'"^(x) 



(20) 



r=i 



where a^ is given by (17). We note that (17) Involves 
no integration, but only the values of f{x) atx = 1, 
x = -1 and («-1) other values of x which depend only 
upon n and not upon the nature of f{x). Usually (17) 
is a better formula for determming the Chebyshev 
coefficients than (10), and an Elllott-803 computer 
programme based on (17) has been fully tested. 



3. EVALUATION OF A FUNCTION IN TERMS OF 
ITS CHEBYSHEV COEFFICIENTS 



We now assume that we have a function f(x) such 



that 



/■(x) «y2ao ^\^ Or Tj.{x) 



(21) 



r=l 



where the a^ have been determined previously, as in 
Section 2 or otherwise, and n has been chosen suf- 
ficiently large for the 'truncation error' introduced by 
terminating the right-hand side of (21) at the («+1)th 
term to be negligible. (This and related errors are 
discussed in Section 5.) If we require f{x) for a given 
X, a possible approach is to substitute from (1), so 
that f{x) is approximated by means of a polynomial of 
degree n. But if we decide that the accuracy is not 
good enough, so that the value of n must be increased, 
the a^ already calculated remain the same, whereas 
the coefficients of a particular power of x below the 
nth do not. Consider therefore the alternative pos- 
sibility of evaluating successively the quantities 
^n'^n- i'fen-2 • • • • ^2,61,^0 Where 

br = 2x 6^+1 - ^r+2 + Or (^n+i = ^n+2 = 0) (22) 
Then it can be shown from (11) tha't 



f{x)=y2{bo-b2} 



(23) 



Clenshaw^ gives modified forms of (22) when it is 
known that alternate coefficients b^ will be zero. 

This modification is based upon the fact that 



T2r(x)=T,(2x^-1) 



(24) 



but for our present purpose it is probably simpler to 
apply directly (22) in all cases for moderate n. 



4. A PARTICULAR CASE 

Suppose that we wish to find the 'Chebyshev series' 
appropriate to the expression 



yi=e^+2x + 5 (_l<x< + 1) 



(25) 



and that we require the result to be accurate to three 
decimal places, so that it will be assumed that cal- 
culations based upon five-figure tables are sufficient- 
ly accurate. We shall also assume that 8 is a suf- 
ficiently high value of n. (If at a later stage it seems 
necessary to increase n, it will be best to double n, 
so that all the calculation already done is still use- 
ful.) The 'Chebyshev coefficients* a^ are given in 
Table 1. 

5. GOODNESS OF FIT AND TRUNCATION ERRORS 

The agreement between yi given by (25) and the 
first nine terms of the corresponding Chebyshev series 
has clearly been Indicated in Table 2; it is appro- 
priate now to consider more generally the errors 
associated with the truncation of Chebyshev series. 

Suppose that we seek to approximate to f(x) by 
means of an expression 

y =V2ao + aiJx(x) + chTiix) + ... + a^T^ix) (r<n) (26) 

and that we do this by trying to satisfy the equations 

f(Xq) =V2ao + aiTi(x^) + a2T2(Xg) + ... + a^j^lxg) (27) 

where 



Vy = cos(qn/n), q =0, 1, 2 



(28) 



Since there are only (r + 1) unknown coefficients 
oo, ch, 02 .... Or and {n + ^) equations (27), we cannot 
in general succeed; our best hope is to attempt a 
solution by least squares, which means that we multi- 
ply equation (27) by ViT ^(1) or 'A when q = 0, by 
y2T5(-1) or y3(-1)^ when q = n, and by T^,(x^) for all 
other values of q, and add. Because of the relations 
(15), the 'I east- squares' equations determining the 



best available values of the coefficients a^ take the 
remarkably simple form 



«-l 



y2f(i) + y2(-i)n/-(_i) +y^ f(xq) j^(x^ 



? = ! 



(29) 



Thus the polynomial (26) can be described as the 
I east-squares best-fitting polynomial of degree rto f(x), 
when the fitting is carried out in the manner indicated 
by equation (27). If it is decided that the fit given by 
(26) is not good enough, and that the value of r must 
be increased, the coefficients of (26) already calcula- 
ted will not be altered when r is increased. (If x is 
replaced by cos^, these results have well known 
counterparts in Fourier-analysis.) 

Clenshaw^ points out that if f(x) is continuous 
and of bounded variation in the interval -l^x^+l, 
there is an expansion of the form 



f(x) = Vioo + aiTi(x) + 



(30) 



which is uniformly convergent throughout the range. 
It is also clear that none of the T^ix) can be numeri- 
cally greater than 1 in the range, and therefore we can 
say immediately that the error due to termination of 
the Chebyshev series (30) at the [n + 1)th term must 
be numerically less than 



r=n+\ 



(31) 



and the above-mentioned uniform convergence guaran- 
tees the arbitrary smallness of (31) for sufficiently 
large n. 



TABLE 1 
Chebyshev Coefficients o^ for y, Given by Equation (25) 



r 





1 


2 


3 


4 


5 


6 


7 


8 


°r 


14.55923 


5.18133 


1.37794 


0.42548 


0.10147 


0.01966 


0.00317 


0.00039 


0.00003 



TABLE 2 
Comparison of y^ and the Sum Yi of the First Nine Terms of its 'Chebyshev Series' 



X 


-1 


-0.75 


-0.5 


-0.25 





0-25 


0-5 


0.75 


1 


yi 


3.13534 


3.72313 


4.36788 


5-10653 


6.0 


7.14872 


8.71828 


10-98169 


14-38906 


Yi 


3-13537 


3-72314 


4.36786 


5.10646 


6.00001 


7-14882 


8.71828 


10-98172 


14.38909 



By repeated use of (12), Clenshaw^ shows that if 
f(x) has a Chebyshev-series expansion given by (30), 
then 



i 



f(x)dx = const. + y2CbTi(x) + y4aiT2(x) + 






con 



r=\ 



where 



Ar 



Sr-l - Or+l 



(33) 



Hence given the o^, we can deduce the A^ directly 
from (33), and the A,, will become negligible for a 
lower value of r than the a^. If on the other hand we 
want to differentiate a Chebyshev series, so that we 
are in effect given the Ay and require the correspond- 
ing Oy, we must first detemiine n so that rA^ is negli- 
gible for r>n, and neglect a^ for r>w; repeated use of 
(33) then gives an_i, a„_2 etc in succession. The 
above remarks mean that once a Chebyshev series has 
been determined for f(x), we can derive the Chebyshev 
series also for the integral and derivative of /(x), and 
adapt (31) to estimate the 'truncation errors' of these 
derived series. 



(32) 



considerable detail; the solution satisfying the 
boundary conditions (35) is y = y ^, where y^ is given 
by (25). If therefore we assume that an approximate 
solution of (34) for the range -1<x^+1 is such that 



y = '7203 +y^ a,Tr(x): ^= V,a6 ^a;Tr(x)\ 



r=l 



r=l 



(36) 



d^y 
dx' 



■ = y2Qb"+ 



o 



(X) 



r^l 



we seek to determine the coefficients o^ directly from 
(34) and (35); any result obtained must be consistent 
with values obtained from Table 1. 



6. CHEBYSHEV APPROXIMATION FOR THE SOLU- 
TION OF AN ORCINARY LINEAR DIFFEREN- 
TIAL EQUATION 

Hitherto we have considered the determination of 
the 'Chebyshev coefficients' when f(x) is given 
explicitly, and the reverse process of evaluating f(x) 
directly if we happen to know its Chebyshev coef- 
ficients. In this section we consider the case when 
i{x) is not initially known explicitly, but is the solution 
of an ordinary linear differential equation with appro- 
priate boundary conditions. This case has been left 
until the end because the arithmetical and algebraic 
details are somewhat more complicated; no difference 
in principle is involved. 

Suppose that we define /"(x) as the solution of the 
ordinary linear differential equation 



d^v dy 

(^ + 2)— - (2x + 5)— + 2y = 
'^^ dx 

with the boundary conditions 



dy 
>' = 6 and — =4 when x = 
dx 



(34) 



(35) 



Now from (12), we have for r = 1, 2 .... 8 

<_1 =a;'Vi +2ra; (37) 

ar_i = a'y^y + 2ray (38) 

and we can obtain a set of linear recurrence relations 
between various a^, a; and < from the differential 
equation (34) itself if we first note that 



d'y 
dx 



= % 



8 
'/20b' +\ a;%(x) 
r=l 



<To(x) +2J«- 1 + <+i)T,(x; 



(39) 



it being understood that o^+i is replaced by If r>7. 

Simil arly 

9 
aiTo(x) +/ ^(Qr-I + (h+])Tr(x) 



dy 

X_«V2 

dx 



r=l 



(40) 



Piaggio-^ studies the differential equation (34) in where a^+i is also taken as zero forr>7. 



Substituting into (34), we thus obtain 

2ab - 5ab + 2ao - 2ai + Oi = 



(41) 



-Or'- 1 + '/2a;_ 1 + 2ar -5a; + la^ - cv+i + y2a;Vi = 



(r = 1, 2 



8) 



(42) 



Equation (41) expresses the fact that the coef- 
ficient of To(x) in (34) is zero, while equation (42) 
expresses the fact that the coefficients of Ti(x), 
T2(x) Te(x) are zero. 

Equations (37), (38), (41) and (42) give us 25 
linear relations between the 27 quantities a^, a^ and 
a^ and therefore in general we should be able to 
express all these quantities as linear combinations 
of any two of them. Let us therefore attempt to 
express all these quantities in terms of oe and cfe, and 
assume that a^ = a^ = a^ = if r>8. The easiest way 
to do this is to start by taking Oe arbitrary, 08=0, 
then repeat the process taking og = 0, o^ arbitrary, and 
add the results. In this way we should usually be 
able to express all the n^ etc as linear combinations 
of Ob and oq, the results could then be substituted in 
the boundary conditions (35) to determine the appro- 
priate values of Oe and a^. 

If we know Og and cfe, (37) with r = 8 gives a^ and 
(38) with r = 8 gives ayl thereafter (42) with r = 8 
gives cfe. 

When we come to r = 7, (37) determines Oe immedi- 
ately but (38) and (42) have both a-, and cfe as unknowns, 
so it is desirable to eliminate a\_-^ from (42) by 
means of (38), and rewrite it in the form 

(2r - 2)a^ = V^Qj^ i - 5a; + 2a;' - 2a; ^^.^ + Vaa;'^! (4-^) 

Putting r = 7 in (43) determines oj and then 
putting r = 7 in (38) determines a^. Then we reduce 
r to 6, substitute into (37) to obtain Cs, into (43) to 
obtain ae and into (38) to obtain as, and so on; the 



process is straightforward until we come to the last 
stage whai r = ^ and we have determined all the 
coefficients except ch, oq, ob and c^. 

When r = 1, (37) can be used as usual to obtain 
aS but (43) does not give any information ^out a^. 
Instead, equating the right-hand side of (43) to zero 
determines the ratio of a^ to Oe, and thus pemiits us 
to express all the coefficients hitherto obtained as 
multiples of oq. The ratio o^/os is 2-000, and in 
Table 3 the coefficients a^ (except Oi), a^ and af are 
expressed in the form 

a^ = X^ae + (iyO^ = v^Os; a; = X^Oe + fi^a^ = v'^Oe 

a^ = X^'Oe + i^Oe = v^Oe (44) 

for r>1; the coefficients oo, Od and aS are expressed 
as linear combinations of Oe and a^ by means of (37), 
(38), and (41). 



Substituting into the boundary conditions (35) we 
therefore find 



Og = 5-61459 X 10'^ Oo = 14-55924 



(45) 



and thus the final values of oo, oi .... oe are those 
given in Table 4; they are in very good agreement 
with the values of the quantities a^ in Table 1 as they 
should be. 



7. ADVANTAGES OF CHEBYSHEV-SERIES APPRO- 
XIMATIONS 

In the foregoing, we have shown, following Glen- 
shaw, ' how to derive the coefficients of a Chebyshev- 
series approximation preferably by means of equation 
(17) and how to evaluate economically f(x) given its 
Chebyshev coefficients preferably by means of equa- 
tion (23). We have also considered the case in \Nhich 
f{x) is given not explicitly but as the solution of a 
linear differential equation (Sections). 



TABLE 3 



r 


K 


f^r 


Vf 


K 


Mr 




K 


V-'r 


v" 


8 


1 





1 





1 


2 


1 


-1-5 


4 


7 


3-25 


2-375 


8 


16 





16 





16 


32 


6 


47-55 


4-725 


57 


45-5 


34-25 


114 


231 


-1-5 


228 


5 


154 


98 


350 


586-6 


56-7 


700 


546 


427 


1400 


4 


1663-55 


71-725 


1806-05 


1585-5 


1014-25 


3614 


6097 


565-5 


7228 


3 


399 


3589-5 


7578 


13895 


630-5 


15156 


13230 


8541 


30312 


2 


76217-75 


-25838-375 


24541 


3979-5 


22551-25 


49082 


89467 


4348-5 


98164 


1 


- 


- 


- 


318766 


-102723 


113320 


29148 


98746 


226640 



TABLE 4 
Final Values of Oy 



r 





1 


2 


3 


4 


5 


6 


7 


8 


Or 


14-55924 


5-18126 


1-37788 


0-42547 


0-10140 


0-01965 


0-00320 


0-00045 


0-00006 



Note that except for r = 0, 1 , 4a, = 2a^ = a^'; forr = 0, 1 the values of a,, a" are ob = 13-11826; 
cfo= 12-23647; ai= 6-36245; 0^=12-72491. 



Now the outstanding advantage of Chebyshev- 
series expansion is that coefficients can be determined 
explicitly from the straightforward formula (29) what- 
ever the degree of the approximating formula, and that 
If it is later necessary to determine an approximating 
formula of higher degree, the coefficients already 
determined do not change (as they would if we sought 
directly to approximate by means of a curve of degree 
r). Then there is seldom any difficulty about the con- 
vergence of a Chebyshev series; the function f(x) 
represented over the range — 1<x<+1 has only to be 
such that f(cos6) has a Fourier series in 6. Again, 
the expression (31) for the 'truncation error' is re- 
markably simple, and so Is the formula (33) by means 
of which Chebyshev series for the integral and deri- 



vative of f(x) can be derived at the same time as that 
for f{x) itself. 
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